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ABSTRACT 

The introduction of the System of Multicultu^ral 
Pluralistic Assessment's (SOMPA's) Sociocultural. Scales potentially 
enables psychologists to more formally acquire and use information 
about sociocultural characteristics within children's families. 
However, until "now, data on the Scale's stability have not been 
available. This paper reports the results of a longitudinal study 
which examines the stability oi: the Sociocultural Scales over a four 
year period. The 44 elementary school children | studied were drawn . 
from middle and lower class Anglo, Black and Mexican American 
families. Although some variance in scores is noted, the 
Sociocultural Scales generally are stable. The magnitude .of change in 
individual and in mean scores is not large, and test-retest 
correlations are moderate to high. While actual changes in family 
conditions may have contributed to score variance, scores on items 
which shoul d have been the same across administrations suggest that 
-respondent or interviewer inconsistencies also may contribute fo 
variance in scores. (Author) 
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SUMMARY: The introduction of the System of Multicultural Pluralistic 
Assessment's Sociocultural Scales potentially enables psychologists to 
more formally acquire and use inf ormatioiri about sociocultural character- 
istics within children's families. However i until now, data on the Scale' 
stability have not been mailable. This paper reports^the results of a 
longitudinal study which examines the stability of the Sociocultural 
Scales over a four year period. The. children studied were drawr. from 
middle and lower class Anglo, black and Mexican American families. 

^Although some variance in scores is noted, the Sociocultural Scales 

* 

generally are stable. The magnitude of change in individual and in mean 
scores is not large, and test-retest correlations are moderate to high. 
While actual changes in family conditions may have contributed to score 
variance, scores on items which should have been the same across admin- 
istrations suggest that respondent or interviewer inconsistencies also 
mayi contribute to variance in scores. 

1 ■ \ - ' ' 



stability of the SOMPA's 
Soclocultural Modalities 

For year^ psychologists have recognized the importance of considering 
the child's background while Interpreting test Information. Dcimographlc 
variables such as gender, race, and socioeconomic status often are seen as 
Important In accurately describing children' 3 development and In planning^ 
for their futures. Psychologists traditionally have relied upon Informal 

6 

/ 

measures of social class as well as their best clinical judgments In assess- 
Ing social status and In determining how the information should be used. 

The recently Introduced Soclocultural Scales from the System of Multi- 
cultural Pluralistic Assessment (SOMPA; Mercer & Lewis, 1977) allow psychol- 
ogists to measure social and cultural characteristics of children's families 
more formally. Moreover, Mercer (1975) proposes that test information from 
various psychometric instruments should be adjusted based upon information 
from Soclocultural Scales . * For lexample, she proposes that WISC-R IQ scores 
should be adjusted to form the estimated learning potential so as to help 
equalize the effects children's social and cultural characteristics have on 
their IQ test performance. 

Though the technology to formally measure and use data on soclocultural 
cliaracterlstics may be available through the SOMPA's Soclocultu ral Sca-Les, 
little psychometric information ^about the Scales is available. Test stan- 
dards CAPA, 1974; Anastasi, 1982) traditionally hai^e emphasized the Impo^ 
ranee of knowing a test's consistency, reliability, or stability in inter- 
preting information. However, even though the Scales were introduced six 



\ 
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years ago, no evidence on their test-retest stability is.available* This 
paper reports the results of a longitudinal study designed to provide data 
on the stability of the Sociocultural Scales over a four year period. 

Methodology 

Subjects , The 44 children for whom Sociocultural Scales data are 
reported were part of a larger study involving approximately 450 childr,en 
ages six through .12 on whom various psychological, social, medical, and 
educational data were acquired (Oakland, 1979, 1980). These children were 
entering grades one through three when they were tested originally in 1976 
(T-) arid were in grades four ttirpugh six when they were retested in 1980 
(T^) . Approximately one-third of the children in this follow-up study are 
from each'of thr^ major racial-ethnic groups (Anglor"^lack and Mexican ^ 
i^erican) , and approximately one-half are from each of two social classes 
(SES; lower and middle). Finally, approximately half of the children in 
the follow-up sample aire male' and half are female. 

Instrument , The S6ciocultural Scales are a part of the SOMPA's Parent 
Interview section. They consist of 22 questions presented in foui sub- 
scales: (1) the Family Size Scale, (2) the Family Structure Scale, (3) the 
Socioeconomic Status Scale, arid (4) the Urban Acculturation Scale. The 
scales are divided further into factors which measure different aspects of 
nhe area considered by the scale; for example, the Family Structure Scale 
contains a Parent-Child Relationship factor and a Marital Status Factor. 
Each scale is scored separately, and raw scores from each scale can be con- 
verted to scaled scores. Scaled scores are available for both the child '.s 
own racial-ethnic group and for the school culture group. ' Scaled scores 
for children's own ethnic groups were used throughout this study. 7 t ~ 

D ' 



Procedures ' ^ 

Subject Selection. The norms for the Sociocultur^'vi Scales include 
children between the. ages of 5 and 11. Therefore, although the original 
(;v ^ } sample included about 450 children, oniy about 150 of them were less . 

r 

than 12 years old and still eligible for testing at T^. About 80 eligible , 
children were located using information from original testing records,* the 
schools, local phone directories, the post office, and other sources (e.g., 
neighbors). These families were contacted by telephone in order to describ 
the follow-up study and make an appointment for a home visit. Families who 
did not have a telephone were contacted directly by home visits. Every 
effort was made to locate and contact all eligible families living in the 
Central Texas area. 

/ Data Collection. Sociocultural Scale's data were acquir^ed through 
par^trr'lSiterviews in children's hiomes by psychologists or social workers. 
All interviewers had previous experience in interviewing families and were 
trained in interviewing and scoring procedures for the Sociocultural Scales 
Families and interviewers were matched hn the basis of racial-ethnic- group 
membership^ for . the folloW-up (.T2) interviews. 

Indices of Stability of the Sociocultural Scales . Since no one 
psychometrically accepted definition of the long term stability of an in- 
strument currently exists, several stability indices were considered for 
the Sociocultural Scales ! These included the stability of group means, the 
stability of test-retest correlations, the stability of lines of best fit*— 

•V ■ ' •■■•1 , 

for coth testings (i.e., and T^) and the stability of individual scores. 
Stability criteria for each of these indices are presented ii^ the Results 
and Discussion section, * 
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One additional index of stability, the equality of scores across ad- 
ministrations, was considered for the Urbanization Factor of the Urban 
Acculti'vncion Scale. Because this factor concerns the populations of 
parents* childhood homes, and therefore a fact which was established 
previous to both administrations of the Sociocultural Scales , scores on 
this factor should be equal at and T^. 

Results and Discussion 
Stability of G roup Means . Group means for each Sociocultural Scale 
show evidence of stability if they do not differ significantly Cp > .05) 
between score administrations. Mean scaled scores are reported for each 
Scale for the total follow-up sample and for each racial-ethnic, gender 
and SES group (Table 1). Results of a two- tailed t test foi: matched samples 
between and T scaled scores for each group and subgroup also are reporte( 



Put Table 1 about here 



In general, the 1976 and 1980,means are about equal; only four of. the 
32 sets of means differ significantly. Mean scores decrease significantly 
on the Family Siiii Scale for Mexican Americans; mean scores increase signif- 
icantly on the Socioeconomic Status Scale for Anglos and low SES families 
and on the Urban Acculturation Scale for middle SES families. 

Stability of Test-R^est; Correlations . Test-retest rank order (rho) 
and Pearson Product Moment correlations for the two administrations of the 
Sociocultural Scales are considered to show evidence ofVstability if they 
achieve statistical significance Cp <.05). 



Put Table/ 2 about here 



Rank order (rho) correlations are reported for the full follow-up sample 
(Table 2). While the magnitude of these cox^relatlons varies somewhat (rang-' 
ing from .50 to ^80), all rank order correlations meet the stability criterion 
of statistical significance. - * 



Put. Table 3 about here 



Pearson Product Moment correlations are reported for each Sociocultural 
Scale for the total sample and all subgroups (Table 3) . Correlations are j 
moderare f or the Family Size Scale (ranging from .the AOs to the raid 70s), / 
and generally are high for the other three Scales (ranging from t^e high 50s 
to the high 90s). All correlations achieve the stability, criterion of 
statistical significance except the correlation for the Family Size Scale 
for Anglos. 

Stability of Lines of Best Fit . Line of best fit results indicate 
stability if the line which best describes 1976 (T^) Sociocuitural Scales 
scaled scores and predicted second administration scores has a slope of one 
and an intercept of zero. Under thes6. conditions the me^n of predicted 
second administration scores for a given first administration score equals 
that first administration score (i.e., while individual scores may show 

some variance due to measurement error, scores are expected to be the same / 

■ / 

across administrations when a group of children is considered). / 
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Predicted scores and equations for lines of best fit were derived 
using a series of linear models (Program MODEL, Ward & Jennings, 1973, pp 
317-327). Predicted 1980 (T2) scores differed from 1976 scores for all 
groups on all scales (I.e., the stability criterion described above was not 
met for any group or Scale) . This suggests that there Is at least some 
variance In scores between administrations. 

Put Table 4 about here 



Equations for predicted scores are presented In Table 4. Equations ^; 
produce the most likely second admliiistratldn score (Y) for a given score^ 
on the first administration (X). For example, the predicted second administra- 
tion Family Size Scale Score for an Anglo child with a first administration 
score of' 55 Is 53. (For Anglos, Y=i6.27 + 0.67X; Y=16.27 + (.0.67 x 55) = 
53.12, which rounds to 53). 

Stability of Individual Scores . Stability of Individual scores was 
examined by using the standard error of measurement for each Soclocultural 
Scale factor. Psychometric theory suggests that any |)bserved score Is a 
combination of an Individual's true score and an error score. In a group 
of observed scores, the percentage of cases in which true scores can be 
expected to Lll within a specified number of standard, errors of measurement 
of their corresponding observed scores can be calculated using the normal 
distribution (Anastasi, 1982). Sixty-eight percent of observed scores can 
be expected to fall within one standard error of measurement of their cor- 
responding true score. Therefore, if true scores ^f or the two administrations 



of the Sociocultural Scales are the same; l;c., if individual scores are 
stable, 68 percent of all second administration scores can be expected to 
fall within one standard error of measurement of first administration scores. 

Factor rather than Scale stability was examined because it was an- 
ticipated that standard errors of measurement associated with a scale that 
combines two or more factors would be very high, and mi^ht lead to an over- 
estimate of the scale's stability. Factors were taken from the. SOl^CPA' s 
technical manual (Mercer, 1980). Since the SOMPA's technical taanual does - 
not provide standard errors, of measurement for either the Sociocultural 
Scales or their factors, standard errors \of measurement were calculated 
from data from the original (T^^) study dcjscribed above (N«450) . 



Put Table 5 about here 



The number and percentage of cases for which scores from the two Socio- 
cultural Scales administrations differ by one standard error of measurement 
or less are reported for the full sample and all subgroups (Table 5).^ Over- 
all, individual scores appear stable for most factors. The stability criter- 
ion of 68 percent of second administration scores within one standard error 
of measurement of^ first administration scores is achieved for the full group 
and for all subgroups for the Parent-Child Relationship factor, the Marital 
Status factor, and the Source of Income factor. The 68 percent criterion is 
not achieved for any group on the Occupation of Head of Household factor. 
However, this factor contains only one item, so. that any chang6 in an answer 
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(rather than any change greater than one standard error of measurement; 
would contribute to "instability." For all other factors, the 68 percent 
criterion is reached for at least one group and is nearly re<iched by sev- 
eral others. 

Stability of the Urbanization Factor of the Urban Acculturation Scaled 
Scores on the Urbanization Factor of the Urban Acculturation Scale are based 

on t\ie population of each parent's childhood home at the time each parent 

\ 

» was growing up. Since parents' childhoods precede both administrations of 
the Sociocultural Scales , scores on tljis factor should be the same for both 
administrations. ' . 



/ Put Table 6 about here 

/ 



. The number and percentage . of cases fl^r which scores, are in fact equal 
are reported for the total sample and a\^l subgroups (Table 6). ^verall, 
scores are about equaXfor half of the tot^l sample and for about half of 
the cases in each subgroup. \ 

In four cases (18 .percent of those which were not equal) tlie change in 

\ ' I 

\ I 

Urbanization Factor score is explained by changes in the respondent or his/ 
her status. For example, in one case, the .mother had become tne head of 
the household between 1976 and 1980. In all other cases CN=18) , either 
responses or the rating assigned to them by interviewers differed between 
the two administrations. 
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Summflry , In QBseselng the overall stability of the Soclocultural 
Scales , various llmltatlonD asaoclatcd with this study' s . saraple ahould be 
considered. ..In addition to Its relatively small alze, the sample Includes 
children who lived In thk Austin, Texas area between 1976 and 1980 whose 
family residence could be traced In some way through school district, 
postal and/ or telephone listings, and whose mothers agreed to participate 
In this study.( Stabll^lty of residence may somehow Internet with families' 
actual soclocultural status or Its assessment. 

In general) Soclocultural Scales scores appear consistent across ad- 
ministrations. / ^hlle line of, best fit results suggest that scores for the 
two administrations are not exactly equal, group means show few significant 
changes, test-retest correlations generally are significant and are moderate 
to high, and changes In Individual scores generally fall within the standard 
error of measurement for. the associated Soclocultural Scales factor. Some 
variance in scpres proiably is attributable to changes dver'^time in families' 
soclocultural status. ' However, scores on the Urbanization factor of the 
Urban Acculturation Scale suggest that respondent br interviewer Inconsis- 
tency also may have contributed to variance in scores. It is possible that 
respondents are inconsistent in their estimates of the population\of their 
childhood home and that interviewers have difficulty cot^sistently estimating 
what the population of an unfamiliar to\m might have been 10 or 20 years ago 
in cases where respondents are unable or unwilling to give an estimate. 
Population records (such as census data) might be made available to inter- 
viewers so ks to improve the reliability of the Urban Acculturation Soclo- 
cultural Scale ^ » 
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Table 1 



Scaled Score Means for 1976. and. 1980 :Administrations of the 



•Socibcultural Scales 



L Group ' 



44 



■Family 
Size 
. Scale /' 

1976 /1980 
•54! 6' 53.0 



. Patiiily 
Structure 
• ' S cale 

1976 1980 
50.5 51.0 



Socioeconomic 
Status 
Scale 

1976 1980 
53.6 ■55.8 



Urban 
Acculturation 
Scale 

1976 1980 
47.7 49.1 



cs -■ 



an AjBerlc'ans" 



16, 
12 
Ifr 



54.1 : 52.\7 
52.5 54.2 
^6.8 52,3* 



45.9 50.0 
51.7; 46.9 
.54.2 55.1 



49.9 55.5* 
56.5 55.0 
55.0' 56.6 



42.4 39.9 
46.8 54.7 
53.7 54.1 



Les' 

;es . 

Le SES 



22 

( - 
22 

20 
24 



52.8- 53.3. 
56.3 ' 52.7 

52.0 50.1 
56.8 55.5 



51.9' 51.7 
49.1 : 50.3 

45.8 47a 
54.5! 54.2 



)robabilities are fajm t "tests for matched samples. 

^.05 , / - .' • . ' 

-^.01 . ' s ' 



55.0 '56.0 
'52.1 55.5 

42.0 48.4*.* 

63.2 - ..61.8 



47.0 49.2 
48.5 49'." 0 

44.8 ' 44.7^' 

50.1 52.7* 
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Table 2 



Rank Order Correlations^etween /97 6 and 1980 Sociocultural Scales 
Scaled Scores for the Txxll Sample. 



Scale 



--ramilxiSrtze"-: . 
Family Structure 
Socioeconomic Status 
Urban Acculturaf' 



N 

44 
42 
44 



Rho 

.50^ 
:75* 
.77*. 
.80* 



* - p < .01 
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Table 3; Pearson Product Moment Correlatipns Between 1976 and 1980 
/ Sociocultuial Scales Scores v. 



•/ 

/ 

/ 

J- 
44 

16 
12 



Family Size 
Scale 

,50*** 



r39 

.76**. 



Family Structu^re 
Scale 

,82*** 



,84*** 
JO** 



Socioeconpmic 
Status Scale 

,78*** 



,82*** 



Urb^n Acculturation 

Scale' 

,75*** 



;89*** 

,62* 



16 

22 
22 



,75*** 

,62*** 
.42* 



^98*** 

,82*** 

,82***: 



,81*** 

,88*** 
,73*** 



,86*** 

,62*** 
, 88*** 



20 
24 



,59** 
.40* 



,84*** 
,72*** 



,58** 
,80*** 



,68*** ; 
. ,84***} 
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Table 4: Equations for Predicted Second Administration Sociocultural Scale Scores 



(1)' 



Family Size 
Scale \ 

Y=i6.27 + O.Wx 

Y=16.27 + 0.67X 
Y=16.27 + 0.67X 

Y=16.27 + 0.67X 

Y=16.27 + 0. . 
Y=16.27 + 0.67X 



Family Structure 
Scale 

Y=15.04 + 0.71X 

Y=15.04 + (f.71X 
Y=15.04 + 0.71X. 

Y==15.04 + 0.71X 

Y=15.04 + 0.71X 
Y=15.04 + 0.71X 



Socioeconomic 
Status. Scale 

Y=21.16 + 0.65X 

Y=21.16 + 0.65X 

Y=21.16 + 0.65X 

■ \ ' i 
Y=21.16 + ,0.65X' 

, ■ - \ " 

Y=21.16 + 0.!^-5X 
Y=21.16:M- 0.65X^ 



Urban 
Accultviration 
Scale 

Y=11.31 + 0.79X 

Y= 2.56 +.1.00X 
Y=34.74 + 0.43X 

Y=-16.76+ 1.32X 

Y=23.60 + 0.54X 
Y=-4.40 + l.lOX 



Y=16.27 + 0.67X 
Y=16.27 + 0.67X 



Y=15.04 + 0.71X 
Y=15.b4 + 0.71X 



Y,=28;50 + 0.48X 
Y=-1.23 + i;OOX 



Y=11.31 + 
Y=11.31 + 



0.79X 
0.79X 



quations produce the most likely second administration score (Y) for. a given score on the first 
dministration (X). For exWl^r thes predicted second administration Family Size Scale Score for 
n Anglo child with a first administration score of 55 is 53. /(Y=16.27 + (0.67 x 55) = 53.12 
hich rounds to 53.) • . 
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Table 5 



Stability of Individual Scores on Soclocultural Scale 
Jactprs_Acqulred Over, a Jour Year Period 





Family 
Size 
Factor 


Parent-Child 
Relationship 
Factor 


Marital 
Status 
Factor 


Source of 
/ . Income 
/ Factor 


Occupation : 
of Head of 
Household^ 


Sense of 
Efficacy 
Factor 


CoDnsuhity 
Participation 
Factor 


Angilca- 
zatlon 
Factor 


Urbanization 
Factor 




(N-43) 


(N-44) 


(N«A4) / 


(N-44) 


(N»43) 


(N-44) 


(N 


-44) 


. (N-44) 


(N-44) 


Group 


29 (67Z) ' 


38 (86%) 

/ ' 


38 (m)i 


37 (84%) 


14 (33%) 


28 (64%) 


" 31 


(70%) 


35 (79%) 


28 (64%) 


s 


10 (63%) 


''/I 16 (100%) 


I 

U (88%) 


12 (75%) 


' 6 (40%) 


^11 (69%) 


12 


(75%) . 


IS (94%) 


li (69%) 


S' ■ 


9 (75%) / 


^ 9 (75%) 


10 (83%) 


12 (100%) , 


4 (33%) 


,6(50%) 


.11 


(92%) 


6 (50%) 


5 (42%). 


an- . 
rlcana 


10 (67%) 


13.(81%) 


/ 

lA^/(88%) 


13 (81%) . 


.5. 4 (25%) 


11 (69%) 


8 


(50%) 


14 (88%). 


12 (75%) • 




U (67%) 


19 (86%) 


' /20 (91%) , 
/l8 (82%) 


21(96%) 


9 C41%) 


11 (50%) 


16 


(73%) ' 


17 (77%) 


13 (59%) 


es . 


15 (68%) 


19 (86%) 


i6 (73%) . 


5 (25%) 


17.(77%) 


■ 15 


(68%) 


18 (82%) 


15 -(68%) 

■ ■ \ 


ES 


W (70%) 


15 (75%r / 


/ .1 . ' 
17 (85%) 


18 (90%) 


7 (35%) 


10 (50%)' 


14 


(70%) 


15 (75%) . 


13 (65%) 


e SES 


15 (65%) 


/- 

23 (96%) / 

/■ . 


21 (88%) 


19 (79%) 


7 (30Z) 


1^X7.5%) 


17 


(71%). 


20V(83%); 


15.(62%) . 



he numbers (and percentages) reflect the number (and percentage) of cases for which ser.ond administration soclocultural factor sQores were 
rlthln one SEM of first administration scores. ' , ' > ' 

he occupation factor contains only one item. Numbers and percentages represent those cases for which the same response was. given for both 
idmlnlstratlons. / 
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Table 6 

I . ° . ■ 

Ninaber and Percentage of Cases with Equal Scores on the Urbanization 
Factor, of the Urban Acculturation Scale. 



Group ' ' N 

Total Sample A3 

Anglos " 16 

Blacks 11 

Mexican Americans , 16 

Low SES - 19 ' 

Middle SES 24 



Number in group 
with equal scores 



21 
'8 
5 
8 
10 
11 



Percentage in group 
with equal scores 

49% 
50% 
45% 
50%; 
.51% 
46% " 
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